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(54) DEVICE FOR CORRECTING DEFECT OF PICTURE ELEMENT 

(57)Abstract: 

PURPOSE: To obtain an excellent picture by detecting 
and correcting a signal while exactly distinguishing a 
picture element defect from a substantial signal in an 
image pickup device employing a solid-state image 
pickup element. 

CONSTITUTION: Picture element data yn-2, yn-1, yn, 
yn+1, yn+2 being a noted picture element yn, picture 
elements yn-1, yn+1 before and after the picture 
elements yn, and picture element yn-2, yn+2 before and 
after the picture element yn-1 , yn+1 are extracted by FFs 
1-4 and the following equation are operated by using 
adders 11-16 and comparator circuits 21-24. Then 
discrimination outputs of the said comparator circuits are 
ANDed, and a picture element is discriminated to be a 

defect of picture element when four following equations are all satisfied, and a detection 
signal and a correction signal are outputted, yn-yn-1> a1, yn-yn+1>a2, yn-1<b1(yn+yn-2)/2, 
yn+Kb2(yn+yn-2)/2. 
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* NOTICES * 

Japan Patent Office is not responsible for any 
damages caused by the use of this translation. 

1 .This document has been translated by computer. So the translation may not reflect the original 
precisely. 

2 **** s hows the word which can not be translated. 
3. In the drawings, any words are not translated. 



DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[Industrial Application] This invention relates to the pixel defective compensator which detects and 
amends the pixel defect which exists in a solid state image sensor in the image pick-up equipment which 
used solid state image sensors, such as CCD. 
[0002] 

[Description of the Prior Art] In the solid state image sensor generally formed with semi-conductors, 
such as CCD, producing image quality degradation according to the local crystal defect of a semi- 
conductor etc. is known. Since the image defect by which fixed bias voltage will always be added to the 
image pick-up output according to the amount of incident light will appear as a white point of high 
brightness on a monitoring screen if this image defective signal is processed as it is, it is called the white 
crack. Moreover, since the low thing of photoelectric sensitivity appears as a black point, it is called the 
black crack (a pixel defect is henceforth called a crack). 

[0003] Conventionally, the detection to the above cracks is shown, for example in JP,61-261974,A. This 
approach is an approach of detecting as a crack the pixel in which an attention pixel has a small large or 
output more than a constant rate to a surrounding pixel, takes the difference between contiguity pixels to 
a longitudinal direction and a lengthwise direction, and detects a pixel with a different output from a 
surrounding pixel. 

[0004] Hereafter, the case of detection of the white crack in the horizontal direction of CCD shall be 
explained, and the conventional pixel defective compensator in this case is explained concretely first. 1 
pixel of white cracks usually projects to a surrounding pixel. For example, the relation between an 
attention pixel and the pixel before and behind that is expressed like drawing 10 (a). For this reason, as 
compared with an attention pixel and a pixel before and after [ that ] adjoining, more than fixed level, an 
attention pixel can regard it as a crack, when larger than the pixel of order. 

[0005] The block diagram which realizes the above-mentioned contents is shown in drawing 9 . The 
inputted signal passes along two or more flip-flops (it omits Following FF) 1 and 2, and obtains the 
attention pixel value sent one by one, the pixel value before and behind that, yn-1, yn, and yn+1. Adders 
1 1 and 12, comparator circuits 21 and 22, and AND circuit 30 are performing the following operation to 
these signals. 
[0006] 

yn-l-yn>al (1 1 
yn+l-yn>a2(12 

al and a2 are the thresholds of the amount of protrusions to yn-1 of yn, and yn+1, and they are 
considered as al= a2=a (> 0) here. 

[0007] When the value of the pixel to observe has projected more than fixed level to the value of the 
pixel of the circumference of it by the above, it is regarded as a crack, and a detection output is 
outputted. An amendment circuit is controlled by the detection output. 

[0008] About amendment of a pixel defect, some approaches are shown in JP,62-8666,A. For example, 
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it is perpendicular similarly, and thinks and there are the approach of permuting by the pixel in front of 1 
pixel or 2 pixels, the approach of permuting by the average of the pixel value of order or an approach of 
permuting by the pixel on one, the approach of permuting by the average of an up-and-down pixel value, 
etc. 

[0009] Here, an amendment circuit shall be permuted by the average of the pixel value of order, a block 
diagram came to be shown in drawing 3 , and the actuation is as follows. The inputted signal passes 
along FFs 5 and 6, and extracts the value of a central attention pixel, and the pixel value before and 
behind that. In quest of these averages, it is considering as the amendment signal from the pixel value 
before and behind an attention pixel. According to the detection output of a detector, when the value of a 
central attention pixel is judged to be a crack, an amendment signal is usually outputted. 
[0010] As mentioned above, to the pixel projected more than fixed level to the value of a surrounding 
pixel, it can detect as a crack, and it can amend so that it may not be conspicuous. 
[0011] 

[Problem(s) to be Solved by the Invention] However, according to the above-mentioned approach, to a 
signal like the point light source, since it has projected in spite of being a signal, it judges with a crack 
accidentally. For example, in the case of a CCD output signal like drawing 10 (b) bright one point, the 
signal of the core will be judged accidentally to be a crack, and will be incorrect-amended in being dark 
in a perimeter. This becomes the form where the signal which should exist essentially was missing, like 
the amendment circuit output signal of drawing 10 (b). Thus, when there was a signal like the point light 
source, image quality was degraded, and it had the problem that a good image could not be obtained. 
[0012] This invention solves such a conventional trouble, distinguishes a signal and a crack with a 
sufficient precision with an easy configuration, amends only about a crack, and it offers the pixel 
defective compensator which can obtain a good image also in an image including a signal like the point 
light source, without degrading original image quality. 
[0013] 

[Means for Solving the Problem] The image pick-up equipment which has the sampling circuit which 

samples the signal which the pixel defective compensator of this invention scanned each pixel of a solid 

state image sensor and a solid state image sensor sequentially, and was read, 
I extracts the value of the 1st pixel, ttej^spf^^^ pixel, and the value of th<T3th y 

\ and 5th pixel in the side which adjoined the 2nd and 3rd pixel and is separated from the 1st pixel/It is 

the pixel defective compensator characterized by consisting of a detector which consists of an arithmetic 

circuit which carries out data processing of the extracted pixel value, and detects a pixel defect, and an 

amendment circuit controlled by the output signal of a detector. 

[0014] 

[Function] A good image can be obtained without amending only about a crack and degrading original 
image quality, since according to this invention incorrect detection and incorrect amendment are not 
performed like before in a signal like the point light source, but a signal and a crack are distinguished 
and a crack can be detected with a sufficient precision. 
[0015] 

[Example] (Example 1) The 1st example of this invention is hereafter explained with reference to a 
drawing. 

[0016] The 1st whole example block diagram of this invention is shown in drawing 1 . Incident light 
reaches CCD 103 via a lens 101 and optics LPF 102, and photo electric conversion is carried out by 
CCD103, and it is changed into a digital signal through the CDS circuit 104 and A-D converter 105. 
Jrom this signal,Ca crack is detecjgj^ a^ad^tecting signal is outputted. The > 

\ amendment circuit Wtircohtrolled by this detecting signal. 7 
[0017] The block diagram of the detector of the 1st example of this invention is shown in drawing 2 . 
The following actuation is performed with this block diagram. It reaches an attention pixel and before 
and after that by FFs 1-4 first, and a total of 5-pixel pixel data yn-2, yn-1, and yn before and behind that, 
yn+1, and yn+2 are extracted further. Here, the clock of FFs 1-4 is the same fCK as the clock of CCD. 
The following operation is performed to these pixel data using adders 1 1-16 and comparators 21-24. 
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[0018] 

yn-yn-l>aT«(l) 

; al=a2=a(>0t 

J yn-Kbl(yn+yn-2)/2 (3) / _ 

f yn+ 1 <b2(y n+y n-2)/2 (4) y 

~ tt judges filling with"b"l=b2==b=l/2 formula (1) and (2) the conditions that the attention pixel has 
projected more than constant value to a circumference pixel. It has judged that this satisfies the 
requirement for being a crack, and the point light source is also included, al and a2 are the thresholds 
forjudging, and they are setting for the amount of protrusions to be more than constant value to al=a2=a 
(> 0) here. These operations are performed using adders 1 1 and 12 and comparator circuits 21 and 22. 
[0019] It judges filling with a formula (3) and (4) the conditions of being more than level with fixed 
pixel data before and after adjoining. This is performing distinction of a crack and the point light source, 
bl and b2 are the multipliers for deciding the threshold forjudging the amount of protrusions of pixel 
data before and after adjoining. Here, the threshold is set up like the right-hand side of a formula (3) and 
(4). The threshold is computed by setting bl and b2 with one attention pixel data, and hanging on an 
average with the pixel data of order, bl and b2 are set up with bl=b2=b=l/2 as an example. These 
operations_are performed using- adders 1 3 , 1 4, 1 5,„and_l 6_ and„comparator circuits 23_and_24..____ 
[0020|AND of an output decision output is taken to l b 

fand it judges filling all of the four above-mentioned formulas. When filling allot four formulas, it 
l^ju^eTwfli a crack, and it controls to output a detecting signal and to output an amendment signal to the* 

i amendment circuit 107 from a detector 106. 
^[0021] The block diagram of the amendment circuit of the 1st example of this invention is shown in 
dra wing 3 . The inputted signal passes along FFs 5 and 6, and extracts the value of a central attention 
pixel, and the pixel value before and behind that. Here, the clock of FFs 5 and 6 is fCK. In quest of these 
averages, it is considering as the amendment signal from the pixel value before and behind an attention 
pixel. According to the detection output of a detector, when the value of a central attention pixel is 
judged to be a crack, an amendment signal is usually outputted. Moreover, time amount doubling with a 
detector shall be performed if needed. 

[0022] (Example 2) The 2nd example of this invention is hereafter explained with reference to a 
drawing. The 2nd whole example block diagram of this invention is shown in drawing 5 . Via a lens 501 
and optics LPF 502, it is separated into each chrominance signal of R, G, and B by prism 503, and 
incident light reaches CCD504,505,506 corresponding to each. CCD505,506 of R and B is horizontally 
arranged to CCD504 of G at half-pixel gap ******. Photo electric conversion is carried out by these 
CCD, and it is changed into a digital signal through the CDS circuit 507,508,509 and A-D converter 
510,511,512. From this signal, a crack is detected in a detector 513 and a detecting signal is outputted. 
The amendment circuit 5 14 is controlled by this detecting signal. 

[0023] The block diagram of the detector of the 2nd example of this invention is shown in drawing 6 . 
Since R and B signal have the same relation to G signal, the case where G signal and R signal are 
inputted into a detector has been shown here. The following actuation is performed with this block 
diagram. G signal and R signal which were inputted first FFs 51 and 52 which operate by the same fCK 
as the clock of CCD A passage, If it is for example, G signal as an attention pixel by after that and FFs 
1-4 which are changed into the serial signal of G and R signal at 2fCK rate by the selector 40 which 
operates by 2fCK(s) A total of the 5-pixel pixel 2 of R signal rn-0.5 before and behind the G signal gn 
and its half-pixel, rn+0.5 and gn-1 around 1 pixel, and gn+1 is extracted. Here, the clock of FFs 1-4 is 
2fCK. The following operation is performed to these pixel data using adders 11-16 and comparator 
circuits 21-24. 
[0024] 

gn-gn-l>al (5) 
gn-gn+l>a2 (6) 
al=a2=a(>0) 
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rn-0.5<bl(gn+gn-l)/2 (7) 
m+0.5<b2(gn+gn+l)/2 (8) 

It judges filling with bl=b2=b= 1/2 formula (5) and (6) the conditions that the attention pixel has 
projected more than constant value to a circumference pixel. It has judged that this satisfies the 
requirement for being a crack, and the point light source is also included, al and a2 are the thresholds 
forjudging, and they are setting for the amount of protrusions to be more than constant value to al=a2=a 
(> 0) here. These operations are performed using adders 1 1 and 12 and comparator circuits 21 and 22. 
[0025] It judges filling with a formula (7) and (8) the conditions of being more than level with fixed 
pixel data before and after adjoining. This is performing distinction of a crack and the point light source, 
bl and b2 are the multipliers for deciding the threshold forjudging the amount of protrusions of pixel 
data before and after adjoining. Here, the threshold is set up like the right-hand side of a formula (7) and 
(8). The threshold is computed by setting bl and b2 with one attention pixel data, and hanging on an 
average with the pixel data of order, bl and b2 are set up with bl=b2=b= 1/2 as an example. These 
operations are performed using adders 13, 14, 15, and 16 and comparator circuits 23 and 24. 
[0026] AND of an output decision output is taken to 1 bit each by the above four comparator circuits, 
and it judges filling all of the four above-mentioned formulas. When filling all of four formulas, it 
judges with a crack, and it controls to output a detecting signal and to output an amendment signal to an 
amendment circuit from a detector. 

[0027] The block diagram of the amendment circuit of the 2nd example of this invention is shown in 
drawing 7 . The inputted signal passes along FFs 5, 6, 7, and 8, and extracts the value of a central 
attention pixel, and the pixel value around the 1 pixel. Here, the clock of FFs 5-8 is fCK. In quest of 
these averages, it is considering as the amendment signal from the pixel value around 1 pixel of an 
attention pixel. An amendment signal is outputted, when it judges with it not being a crack and the value 
of a central attention pixel is judged according to the detection output of a detector to be a crack. 
Moreover, time amount doubling with a detector shall be performed if needed. 

[0028] Although Mino explanation about a white crack is given about the above examples 1 and 2, it is 
detectable similarly by changing the sense of the sign of al and a2, and a greater than sign in 
consideration of the direction of a crack being opposite also about a black crack. ^ 
ff0029] Moreover, although Mino explanation about I|H®I^ the above > 

f example, it is perpendicularly the same and the processing which combined both horizontal and a *\ 

/ " " 

[0030] 

[Effect of the Invention] A good image can be obtained without amending only about a crack and 
degrading original image quality, since according to this invention incorrect detection and incorrect 
amendment are not performed like before in a signal like the point light source, but a signal and a crack 
are distinguished and a crack can be detected with a sufficient precision so that more clearly than the 
above explanation. 



[Translation done ] 
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DESCRIPTION OF DRAWINGS 



[Brief Description of the Drawings] 

[Diawiiig_2J The block diagram of the whole configuration of the pixel defective compensator of the 1st 
example of this invention 

[Drawing 2] The block diagram of the detector of the pixel defective compensator of the 1st example of 
this invention 

[Drawing 3] The block diagram of the amendment circuit of the pixel defective compensator of the 1st 
example of this invention 

[Drawing 4] The signal wave form in the 1st example of this invention 

[Drawing 5] The block diagram of the whole configuration of the pixel defective compensator of the 2nd 
example of this invention 

[Drawing 6] The block diagram of the detector of the pixel defective compensator of the 2nd example of 
this invention 

[Drawing 7] The block diagram of the amendment circuit of the pixel defective compensator of the 2nd 
example of this invention 

[DlAYdngJU The signal wave form where the 2nd example of this invention can be set 
[Drawing 9] The block diagram of the detector of the conventional pixel defective compensator 
Prawing 10] The signal wave form of the conventional pixel defective compensator 
[Description of Notations] 
103 CCD 

105 A/D Converter 

106 Detector 

107 Amendment Circuit 
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* ( 1 ) , ( 2 ) aBBX^JSfflBSRfcSt l-c- 
«ffi^Lh§ltH tT US b V* 3 ^mtztZ b *JHJgt 

tSrfl^LTfcOs ai, azti^ifi 

m.ff-%MW±x'hhz t *>mt&t:vx?) iz^mx 

J>9. ZZX'itai = a2 = a (>0) il/C^S. Ztl 

t><7)m.*hmm 1.12, Jt$M2 1 , 2 2*jb 

[ 0 0 1 9 3 S ( 3 ) , (4) Tli, Mg-fSflfflfcOB 

1*4. b u bjUIWR-fftMtttoBJftT-^^taifc 

dtli. LfcHttfc. 5^ (3) , (4) ^ia^iptc 
RfeUTV^. bi, bj^BBRf-^ilffls^T 
ttttoBSRf'-^tWT^fcUftft, t&v^S:JWlLT 
V*4. bi, bi\$-mbLX, bi = b 2 = b = l/2fc 

wfeLXhh. ziit>cr>mn&}m®i3, 14, 1 

5, 16, HMW23, 24Zm^Xftr>X^&. 

40 [0 020] a±<04{I«0jtKHJm;J:S#l t' 7 h(C 

L, ^fBll]SS10 6i:0^a}ft^2:ai^Us fflEHIS&l 

[0021] 1 <mmm<rmssm<»7* 

^H*H3t3iff. A*?tifc«*iFF5. 6 2rii 
0, «f»*wttBB«<oflk*«>tt«W)BSMI^J*asi- 

6. ££T. FF 5 . 6*>?n-jr?Mtf«"e*4. 
B»<0«»OB«tt*» £ it h <W*>m: WXKEOto 

50 bLx^i. mtumcomitiiiij) tzmw m%i,i*&<r> 
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"T4. *fc«ailll»k<OBWB^*>*tt*»:i6tff3t> 

[0022] ( gltffl 2 ) JilT . 2 cOHjISi?!) 

<^£tt7"oy?0£05fcjjrf. *Mt%iiWsX50 
1. *¥LPF5 0 2£«iU 7"l>XA5 0 3fcJ: 

r, g, Bn&m^izftmti. ttiz'tiizm 

LfcCCD504. 505, 5 0 6fcH»*4. GOC 

CD504fc*fU R, BOCCD50 5, 506(±* 10 

CCDfc,k>)3l£*SM$fU CDS0B5O7, 50 
8. 5 09, AD£$3§5 1 0. 511, 512Zft 

5 1 3T*x*i*aiu fcajft^a^-r*. r««KB 

J: OHEEiaBS 1 4 £«!»■*■*. 
[0023] *»WO»2 OUttMottffiigHKOr n -y 
?B*B6fc**t. GflWJctfU R, BflWiRlfcW 
ffitcft&fcfts ££?ti. ftffiUlBtCGfi^kRfl^ 
A*3*ifc*&K'OVvCjj*L'C*4. iW/o^HT 20 

CDC0^n>y^t|SJt.fcxTi6frfl)FF5 1 . 5 2 £ 
310, 2 fc»*CUfM-4-bl/^^4 0fc:J:0 2 fcuV- 

F F 1 ~4 fcj: OiiSBSi: LTW;LtfG«9fc*4 
Gii9gnt*<0*B*|}tt<ORfi#rn-o.6. r 

n*0.5. iJit/flffl^mffSOgn-U gn* 1 Oft" 5BS£> 

BJfc£»iM-4. ii-ciis ffi~4co^d-7? 

ti, 2fcK"t**. £*i&*>B*F-*tetfU 
11-16, J&RQIB2 1 ~2 4 *m^Tt?.comg.Z'rt 30 
•5. 

[00 24] 

gn-gn-l>ai (5) 
gn-gntl>a2 (6) 

ai = a2 = a (> 0 ) 

rn-0.5<b! ( gn + gn-l ) /2 ( 7 ) 

rn»d. 6<b2 ( gn + gn+1 ) /2 (8) 

bi = b» = b=l/2 

3$ < 5 ) . ( 6 ) Tl±» aBB** t fflfflB*K«L"C- 
Jgffla±aaLT^4fc^3*tt$»n:*£i*«^ 40 

*. itifcio^ *XT-*4fc»<0ifi**frfc»fc"*-£ 

£>9. ;:tl±ai = a2=a (>0) t LTH4. .Ift 

f>coigg£ flDgn 1 1 . i2, uam»2i. 22*m 
[00251am. (8) rii. H»t*»a<oi 

^4. b K bilifl^41l«OB*7 f -*tf>g«B*S: 50 
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flSlt4fe*WL*v\fflSiJW>4feA<0«ft'C*4. C 
C-tti. t*V»itfc % *(7) , (8) 0):frifl*>J:3(C 
RJ6LT^4. bi. b»*aiiB*T-^k Hftfe^T 
WtfcOB*T-*fcOWfcJJHt, L*^«*»ajLT 
V>4. bi. bitt-Wfcl/C. bi = b2 = b = l/2t 

K£i/ca4. ztihomnztmrni 3, 14. 1 

5, 16.JH8EB2 3, 24fcffl<»vef?-»-o>4. 
[0026] JJLh»4fl*0it«igBt J:4# 1 t'-y He 

■*-£fc*fljef4. 4^S-r^T}?t^-rt^=¥Xfc^ 
U ttffl0BJ:9«iMW-&ayjU ffluEtUBtifiBI 
*&iWrf4J:3IW*ir4. 
[00273 *^B^m2«0*SSWc0liI[lIBO7 , n >y 
?H*H7l=*t. A*S#lfcfa*iFF5. 6, 7. 
8 & ii 0 . B B§£«9<I k 1 BB^fif^H^ 

ttfcttft-f-?.. ££T\ FF5~8(7)^ny?(ifcK-C- 

&4. asBsoiB^frf^asfflA^iti^oTft) 
***«>*iiEOTfctTv^4. «ajniBwttaias*te«E 

[0028] ELLaSOtW 1 . 2 fcoVvtJi. a^f X(C 

dpXO*l*l*«R«-C»4Ct«r#*L.. ai. azWft 
W^^MS»fr3E3Et4ikt:J:'3, IB|*t:ttBJ*« 

[ o o 2 9 j v±±.<r)mm,mz^x\i. *witi 

fc*DHfc?IIBr*4. 

[0030] 

»*ft<«a-C*43t«>. df-Xfcov^^)*»iE*ff 
W :*3feomm&ftStf4£J:$r<. A^Bft^tt 
4£k**T*4. 

[tan *%m%\<r)mmmmxwm-mw<?>± 

[02 ] XftWom l a£^aBS*MiE£fflatt 

ai0BO7'n</^ia 

[03 ] *%Bg^ff 1 (OUttn^BXXMMiQSil^tt 

IlHlBO7'O-y^0 

[04 ] *%W<r)n l agflOT£&lt4<i*»» 

[053 ^^Bflcom 2 <7)m&m<7)wmmniE$im<?>k 

[H6 3 *««O»2<^afc«WB«5iW*llKt<0tt 

amiBoyp-y^0 

[H7] *«WW»2«««WwB*«iMIE»lt«B 
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im8 ] *wmm20>mmm<r)i5V&m^im 
m9] mmwmwmiE.mm<nmii! l ®$&co7n-y-7 
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1 0 5 A/D^ffi^ 

106 8!lii|BlS§ 

1 0 7 ttEHItt 
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l~8 VJvy'va-yy' 
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[04] 
(a) «<o«i 

o o 



yn-s yn-i Vn y n +i Vn+2 



y„- 2 y n _, y n yn+i y rt+2 



[07] 



7 5 
o-^-JfF^ — FF 



6 8 



-A- FF 



FF -, 



n 




yn-2 y n -i y n yn+i y n+ 2 



CCDtB^fH^ 



L_L_L 



Yn-Z yn-i y« Ym-\ y r +;> 



[06] 
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[08] 

(a) 



gn-l r n -o.5 Qn Tn+0.5 Sn-H 



Qn— 1 rn-o.5 g n TfH-o.5 gnu 



(b) 



9n-i Tn-O.S 9n r n +0.5 g n +i 



! 1 I 



Qn-i Tn-o.5 gn l^t+o^ 9n+l 



[09] 




[010] 
(a) +Xco^£r 



y n -2 y n -i yn+i 



Art fit* 



y n _ 2 y n _, yn y.+t y°+z 



(b) 

! I I 



yn-2 Yn-I yn Vnf) yn+2 



L_L1 



yr>-2 yn-i yn yn+i y»+2 
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